Week 3 Data mining and processing

In this class, we learn how to review the elements of online web pages and provide guidance for subsequent work by mining effective data.

Now is the era of big data, where a large amount of data is collected, uploaded, and distributed every day. Some people say that this has gradually created information rich and information poor; others say that this has caused information overload. But it is undeniable that in the digital age, people need massive amounts of data, algorithms need a lot of data to train, people need data to make decisions, and even children who have just surfed the Internet will be told that the webpage they log in to will collect their data and make an identical data portrait for them.

A variety of data mining tools were provided in the class. Although their interfaces were different, their principles were basically similar. I tried to use the Octopus Collector to crawl the most popular movies on the BBC Movie Channel. Such data may tell me what people like to watch most at the moment, and then guide me to intentionally approach these topics during filming.